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Abstract. This manuscript investigates the relationship between Blackwcll Approachabihty, a 
stochastic vector-valued repeated game, and minimax theory, a single-play scalar-valued scenario. 
First, it is established in a general setting — one not permitting invocation of minimax the- 
ory — that Blackwell's Approachabihty Theorem (Blackwell [l]) and its generalization due to 
Hou [6] are still valid. Second, minimax structure grants a result in the spirit of Blackwell's 
weak-approachability conjecture (Blackwell [l]), later resolved by Vieille 1111 , that any set is either 
approachable by one player, or avoidable by the opponent. This analysis also reveals a strategy 
for the opponent. 



1. Introduction. 

Consider a repeated game between two players, one selecting xt G X, the other yt G 3^, where the 
payoff is determined by a vector-valued function / : X x y ^ M.'^. In Blackwell's Approachabihty 
Game (Blackwell [T]), the player choosing from X tries to keep the center of gravity t^^ J2l=ifi^i^ Vi) 
arbitrarily close to some target set S C W^^ whereas the opponent aims to deny this. 

This game has many interesting applications: the existence of Hannan consistent forecasters 
(Blackwell [2]) and calibrated forecasters (Foster and Vohra [4 ), to name a few. But on the abstract 
side, the basic quandary is: what is the equilibrium structure? 

This was a central question of Blackwell's original manuscript, "An analog of the minimax theorem 
for vector payoffs" (Blackwell [1 ). Both there, and in subsequent presentations, one may find 
invocations of standard minimax theory; for instance, when establishing Blackwell's Approachabihty 
Theorem, which geometrically characterizes sets where the A'-player can guarantee victory. But the 
usual setting had linear payoffs and convex compact domains, which are the sufficient conditions 
for von Neumann's Minimax Theorem. The question thus remains: what is the real relationship 
between equilibria in Blackwell Games, and scalar-valued minimax theory? 

The goal of this manuscript is to determine this dependence by working in a more general setting 
(i.e., a choice of {X,y,f) where minimax theorems may simply fail). The organization will be 
provided shortly, but the main results can be summarized intuitively. Recall that standard minimax 
theorems — usually providing min^g;^^ maxj,g;y f{x, y) — maiiy^y mina;g;(:' f{x, y) for some family of 
sets and scalar-valued functions — can be interpreted as stating that the order of the players does 
not affect the dynamics. This will be carried over to the vector-valued case. 

• Hou's generalization of the Blackwell Approachabihty Theorem (cf. Hou [6], later redis- 
covered by Spinat [TU]) characterizes the approachable sets when the A'-player moves first; 
it considers no other order, and thus holds without any appeal to minimax theory. (Cf. 



Theorem 4.15 ) 



When minimax holds for certain scalar-valued subproblems, then the player order may be 
reversed without changing the dynamics. This will be used to prove a result similar to 



Vieille's weak-approachability/weak-excludability theorem (Vieille [H]): Theorem 4.16 will 
effectively state that minimax structure removes the impact of order in approachabihty 
games. 
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The above characterization made ghb reference to scalar-valued subproblems. The most natural 
appearance of these is to consider halfspaces as target sets, and specifically the scalar-valued game 
which arises by projecting / onto the halfspace's normal. Such scalarizations have always appeared 
centrally in the discussion of Blackwell approachability — indeed, Blackwell's approach strategy 
(which was also used by Hou is a greedy algorithm that chooses a halfspace orthogonal to the 
current projection onto the target set, and attempts to force a payoff inside it. A side goal of this 
manuscript is to provide a deeper understanding of the role played by halfspaces; this turns out 
to be a convenient detour, as these scalarizations grant an easy mechanism to trace the impact of 
(scalar-valued) minimax theory. 

This manuscript is organized as a progression from minimax problems to the full approachability 
game. Specifically, after presenting background in Section [2] deterministic single-play vector- valued 
games are in Section |3] deterministic repeated-play vector- valued games are in Section [4j finally, 
stochastic repeated-play vector- valued games are in Section [5j 

The single-play games of Section |3) though trivial, carry the essential ingredients of the eventual 
message. First, minimax properties are only needed in the vector- valued case where they are in 
needed in the scalar-valued cases: precisely when the order of the players must be reversed. Second, 
this reversal only works for halfspaces: even in the case of compact convex sets, the dynamics become 
unintelligible. 

The repeated games of Section |4] provide the heart of the matter. First, this section develops a 
geometric characterization of approachable sets in the spirit of Blackwell, Hou, and Spinat pilSlllO). 
but in general spaces which may disallow the application of minimax theorems. Second, in the spirit 
of weak-approachability/weak-excludability results (Vieille [H]), it provides a characterization of 
general sets as either approachable by one player, or avoidable by the other. This second result 
depends on minimax structure, and can fail without it. This section also presents a strategy for the 
opponent. 

To close. Section |5] confirms that studying the deterministic cases suffices: the stochastic and 
deterministic settings have the same approachable sets. 

2. Background. 

Denote by (•, •) and || • || the standard inner product and norm on M''. For two points (t),ip & M'', 
overload interval notation for higher dimensions: e.g., [0, V"] •= {o'-'P + (1 ^ oi)i-' : a G [0, 1]}. Write 
p{(j),i^) := \\4> — V'IIj and for a set S' C M'', define p{(j),S) :— inf^gg p((/), i/i). Let B{(j),e) denote the 
closed ball of radius e, and := S + -6(0, e) be the e-neighborhood of S. Recall that, for nonempty 
compact sets 5, J7 C M'*, the Hausdorff metric A(5, U) := inf{e >0:S'C[/gA?7C S'J is complete 
(cf. Munkres Exercise 45.7]). Finally, for any set S, let S°, S, and S'^ respectively denote the 
interior, closure, and complement of S. 

This manuscript will consider both single-play vector-valued games, termed forcing games, and re- 
peated games, termed approachability games. These games are characterized by a 4-tuple {X, y,f, S). 

• One player, the A'-player or simply X, chooses x € X; the opponent (similarly 3^-player or 
just 3^) chooses y G 3^. 

• A bounded function / : X x y ^ R"^ with bound \\f{x, y)\\ < 7 determines the payoff. 

• The X-p\a.yei desires payoffs near a target set S C M"^; the 3^-player tries to avoid S. 
Boundedness of / is necessary to the analysis; note that the strict inequality prevents 7 = 0, which 
is a trivial scenario anyway. 

Definition 2.1. Say g : X x y ^ M. has the minimax property when there exist x £ X , y E y 
satisfying 

supg(x,2/) < g{x,y) < M g{x,y). 

(This provides inf^ swpy g{x,y) = sup^, inf^; 5(2;, j/).) A function f : X x y ^ M'' has the minimax 
property when, for every A G K'', the function (/(•,•), A) has the minimax property. 
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This latter property is quite restrictive, and Appendix [P] discusses function classes which satisfy 
it. Reliance on the minimax property will always be stated explicitly. 

The single-play game is defined as foUows; note that, with the exception of Section [5} the games 
in this manuscript are deterministic. 

Definition 2.2. A forcing game has only one round, where X wins iff /(a:,y) € S {y wins iff 
/ (x, y) G S"^). Say X can force S as player 1, or more succinctly X can 1-force S, when 3a; € X.\fy e 
y .f{x,y) G S. The weaker property that X can 2-force S means ^y € y .3x € X .f{x,y) £ S. 
Analogously, one can define f- and 2-forcing for 3^, where the goal is now S'^. 

This terminology reflects an ordering of player moves induced by the quantifiers. Suppose X can 
1-force S; then even ii y G y is selected with knowledge of the chosen x G X, an x exists so that 
f{x,y) e S. On the other hand, if y can 2-force S*"^, and if this choice is with knowledge of the 
selected x G X, then the outcome /(x, y) ^ S can be forced. If X can 1-force S, it can win with 
either order. But if X can only 2-force S, then in general it can only win as the player who moves 
last. 

In the repeated game setting, players choose (a;t)t^i and {ytj'^n and have access to the selection 
history Tit '■= ((a^i, 2/i))i=i- ^ strategy for X is a. family of functions g := (gt : {X x 3^)*~^ — >■ X)'^i\ 
analogously, a strategy for 3^ is a family t) := (f)t : (A'xJ^)*"^ y)t^i- In round i+1, the players are 
presented the current history 'Ht '■= i{xi,yi))i=i, then select xt+i := Qt+iiHt) and yt+i '■= f)t+i('Ht). 

Given a history Ht, define (/)t :— J^i^ifi^i^Ui)- the goal in the (deterministic) repeated 
setting will be to manipulate this center of gravity, where the averaging will suffice to make the 
family of approachable sets much richer than the forcible sets. 

Definition 2.3. A set S (or, for clarity, a tuple {X,y,f,S)) is approachable when 

30 . Ve > . ar . Vf) . Vi > T . 0t e 5^. 

Any g satisfying this definition is an approach strategy. 

In other words, limf_>.oo inf^gg ||0t — z\\ = 0, and this convergence is uniform with respect to the 
family of opponent strategies. 

Note that for any A'-player strategy g, there exists a family of opponent strategies which assume 
that X is playing g; these strategies effectively choose yt knowing xt- Moreover, these strategies are 
considered in the universal quantification over opponent strategies in the definition of approachabil- 
ity. As such, when constructing an approach strategy, what the X-piayer can force in each round are 
the 1-forcible sets; analogously, the opponent strategy is working with 2-forcible sets. Said another 
way, the quantification order in the definition of approachability implies another setting where X 
moves first, and y observes this before moving. 

It is thus natural to consider the effect of reordering these quantifiers. First, one can say S is not 
approachable when 

Vg . 3e > . VT . 3() . 3t > T . 0t ^ S",. 
Reversing the quantifiers for g and f) yields a setting where y moves first. 

Definition 2.4. A set S (or, for clarity, a tuple {X,y,f, S)) is avoidable when 

3f) . 3e > . VT . Vg . 3t > T . 0f ^ S",. 
Any f) satisfying this definition is an avoidance strategy. 

Mirroring the discussion of player order and approachability, an avoidance game effectively has 
the y player move first, and X chooses with knowledge of this move. Correspondingly, in any given 
round, y can force 1-forcible sets, and X has the easier criterion of 2-forcible sets. 

Blackwell considered a stronger property than avoidability, called excludability, where the quan- 
tifiers 3e > 0, VT, and 3t > T were respectively replaced with Ve > 0, 3T, and Vi > T, thus 
matching the goal of the A'-player. While there exist games which are neither approachable nor 
excludable (Blackwell (Ij), a weaker definition grants that every game is either weak-approachable 
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or weak-excludable (Vieille |lljV Section |4] will show that, under the minimax property, every game 
is either approachable or avoidable; as in the scalar-valued setting, minimax structure nullifies the 
effect of player order. 

A few final technical conveniences are in order. Since S is approachable iff its closure is approach- 
able, this manuscript will follow the usual convention of considering only the case that S is closed. 
Next, every superset S' of an approachable set S" C S" is itself approachable, simply by running 
the approach strategy for S. Combining this with the fact that / is bounded, it suffices to consider 
only compact sets. Lastly, define conv(y(A',3^)) to be the convex hull of the range of/; notice that 
<^teconvC/-(A',3^)). 

3. Forcing Games. 

A few properties are straight from the definitions. 

• X can 1-force S' iff 3^ can not 2- force S"^. 

• If A" can 1-force S, then it can 1-force S' 3 S. 

• X can 1-force 5 iff S* intersects every set S" which can be 2-forced by y. 

• If A" can 1-force S, then X can 2-force S. 

Attempting to reverse this final property is where things become interesting. 

Proposition 3.1. Let any halfspace H := {z M'' : (A, z) < c} he given, and suppose {/{■,■), X') 
has the minimax property. If X can 2-force H, then X can 1-force H. 

Proof. Given any y ^ y, choose Xy Cz X satisfying /(a; j,, y) G H. Since for all y 

c > {f{xy,y),X) > M^(f{x,y),X) , 

it follows that 

c > sup inf (/(a;,y),A) = sup y). A) , 

where the existence of x is from the minimax property. It follows that for every y € y, f{x,y) € 
H. □ 

To see that minimax structure is necessary, it suffices to consider a game in with a := 
inf a: supj,/(a;, y) > supy mixf {x,y) ='■ b; in particular, the set H := (— oo, (a -I- b) /2] can be 2-forced 
by X, but not 1-forced. This problem can then be lifted to any dimension c? > 1 by constructing 
f :Xxy-^ M'' with (/'(•,•): A) =/(•,•): and considering the set H' := {zGR'^ : (A,z) < {a+b)/2}. 
This final example also demonstrates how the restriction to halfspaces fits in: the game is effectively 
projected onto the halfspace normal, thus becoming scalar- valued. 

So the natural question is: what can be said about sets which are not halfspaces? 

3.1. Vector- valued Games as 3-player Games. Even in the case of minimax structure and 
compact convex target sets, there are 2-forcible sets which can not be 1-forced: such an example 
appears in Appendix \X\ The goal of this subsection is to investigate why these difficulties arise. 
First note the following characterization of (closed convex) set membership. 

Proposition 3.2. Let a closed convex nonempty set S and any point (f> € M.'^ he given. Let cts(A) = 
sup^g5 (z. A) denote the support function of S . Then 

cj)(z S sup {(f), A) - crs(A) = 0. 

||A||<1 

As (j) G S is equivalent to mfz^s \\<t' ^ = 0, this statement can be understood via convex 
duality. 
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Figure 1. Depiction of Definition 4.1 



Proof. In general, sup||;)^||<l {<f>,X) — crs(A) > (0,0) — 0-5(0) — 0. Suppose (j> G S; then for any 

A, (0, A) < sup^gg (0, A) = crs{X), thus sup;^((/). A) — o's(A) < 0. On the other hand, if (j) ^ S, 

there exists a halfspace H = {z G R'^ : (A',z) < c} satisfying S C H and (p ^ H, meaning 

fTs(A') < r7^f(A') - c < (0, A') so ((/), A') - asiX') > 0. □ 

For any closed convex set S", consider the scalar valued function 

Bs{x,y,X) := {f{x,y),X) - crs{X)- 



Set Z ■.= {XeR'^ : \\X\\ < 1}; Proposition 3.2 grants 



X can 1-force S => inf sup sup jjsi^i 2/j X) = 0, 

xex y^y x^z 

X can 2-force 5* => sup inf sup gs{x, y, A) = 0. 

yey \ez 

In general, infj^ sup^^ sup;i,/(a;, y. A) > sup^, inf^; sup;^/(a::, y, A). But when this does not hold with 
equality for a 2-forcible 5*, one has an example which is 2-forcible but not 1-forcible. The remaining 
discussion thus considers this expression. 

Suppose now that X,y are convex and compact, and that f{-,y) is convex for every y G 3^, 
and /(x, •) is concave for every x G X. Since (•,•) is bilinear and ug is a convex function (cf. 
Hiriart-Urruty and Lemarechal [5, Proposition B.2.1.2]), _/75 is concave in A. 

Indeed, gs can be viewed as providing the payoff for a 3-player game. The aforementioned 
structure suffices to grant one type of equilibrium: in particular, the existence of Nash Equilibria 
(cf. Borwein and Lewis [31 Exercise 8.3. 10. d] for a suitable generalization). But that only grants 
that players have no incentive to deviate without collusion, whereas here y and A are effectively 
cooperating. The function sup;^^5(a;, •, A) is highly nonconvex, and thus lacks the usual structure 
allowing a statement like inf^, supj, sup_!^_^5(a;, y. A) = supj, inf^; sup_;^_^s(2;, y. A). Thus, in general, 
there is a gap between the two sides of this expression. 

This third player choosing A thus introduces major difficulty into the problem. Note that in the 
repeated game, only one A is chosen (not a sequence, as with xt and yt). This suffices to make the 
approachable sets far different from the forcible sets. Furthermore, the strategies for both players 
can be seen as attempting to work with or against this third player A, whose maximizing choice is 
the direction of projection onto S*, equivalcntly a hyperplane tangent to S. 



4. APPROACHABILITY GAMES. 

Halfspaces continue to be central in the repeated game setting; the following definition provides 
the basic tool whereby a halfspace is useful to either player. 

Definition 4.1. Consider, as in Figure [l] a pair of points ip & S and cj) £ conv{f{X,y)) \ S with 
p{(t>,'4}) — p{(t>,S), and a halfspace H orthogonal to and also passing through [(/),?A). Refer to any 
tuple (0, ip, H) satisfying this arrangement as a halfspace-forcing candidate for S. If X can 1-force 
H, call this a halfspace-forcing example for S. When X can not 1-force H (meaning y can 2-force 
H'^), call this tuple a halfspace-forcing counterexample for S. 
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Consider a halfspace-forcing candidate (0, -ijj, H) for some compact set S. If this is a halfspace- 
forcing example, and 4> — <pt = Vi) ^^r some iteration then the X player may force H 

and move closer to S; this will be proved in Lemma |4.3[ and will provide the basis for the approach 
strategy g* . On the other hand, if this is a halfspace-forcing counterexample, and 0f is close to 
-0 for some iteration t, then the opponent may force iJ"^ and move away from S; this is proved in 
Lemma [Ts] and provides the basis for the opponent strategy [}*. 

Halfspace-forcing examples were used by Blackwell |T] to construct the original greedy approach 
strategy (and were again used by Hou [S] and Spinat |10j): the only distinction here is that the 
halfspaces need not touch the target S. Where the present work truly departs from earlier works 
is by also developing a theory of unapproachable sets with halfspaces as a starting point. This will 
allow the construction of an opponent strategy t)*, and also make it easy to measure the impact of 



minimax structure (since, combined with Proposition 3.1 and properties of forcible sets, if (</>, "0, H) is 



a halfspace-forcing counterexample, then y may equivalently 1-force and 2-force H'^), culminating in 



the approachability/avoidability statement of Theorem 4.16 The following definition, which extends 



halfspace-forcing into a global property, will characterize the approachable sets in Theorem 4.15 

Definition 4.2. A set C M'^ is an A-set if it has no halfspace-forcing counterexamples. 

In the case that X is compact and fi-,y) is continuous for every y e 3^, an A-set S will also 
satisfy a stronger property that halfspace-forcing candidates {(j),ip,H) may place H tangent to S. 
Indeed, this grants a type of set called a B-set by Spinat [KT, which was used there to characterize 
approachable sets. In that setting, however, the compactness and continuity were guaranteed; in 
the more general choice of {X,y,f) here, the relaxed notion of A-set is necessary and sufficient. 

4.1. Sufficient Conditions for Approachability. First, a quantification of the progress granted 
by a single halfspace-forcing example. 

Lemma 4.3. Let (0, ^, H) be a halfspace-forcing example for S , and set r := p{ip, H'^). Then there 
exists X ^ X so that, for any y G y, 

{f{x,y) -ip,(l)-ip) < Tj. 

Proof. Set i/y to be the projection of onto H, and choose any x G X providing 1-forcibility of H. 
Then, for any y G y, 

(/(x,y)-?A,0-^A) -(/(S,y)-^',0-0') + (0'-^,0-'/') <0 + r7, 
which made use of ||0 — ^|| < 7. □ 

This lemma leads to the following greedy strategy g* = (flj for the approach player, parame- 
terized by a family of tolerances (Tt)^^ (these tolerances being the only modification to the strategy 
provided by Blackwell, Hou, and Spinat [1, 6, 10 ). 

Definition 4.4. The ^Y-player strategy g* = (gj)t>i is 

X 3x, ipt, Ht • {<f)ti "ipt, Ht) is a halfspace-forcing example for 5, 

0t*+i(^t) := { piA.Hi) < rt^y Gy.f{x,y) £ H; 

arbitrary otherwise. 

Theorem 4.5. Let an A-set S , any tolerances (Tt)^" with X]i>i '''■i 1^ 1 o-^d Tt > 0, and any e > 
be given. If X uses strategy q* , then for any opponent strategy and any t > 87^ /e^, 4>t £ S^. 

The proof reveals that X]*=i ~ ^i^) suffices; requiring a constant bound is for convenience. 

Proof. So that is always defined, set ipt '■= 4>t when 0t € S. It will be shown by induction that 

lU / l|2 ^ 7^ + 27^*^1 T, 
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Figure 2. Depiction of Lemma 



4.8 



the result follows by applying the bounds for J^i '''i ^-^id t, then taking a square root. 
In the base case, H^i — V'lll < 7- For the inductive step, 



\\(j)t+l - V't+l|l2 < ll'/'t+l 
1 



t|l2 



(4.6) 



1 



ih) + {f{xt+i,Vt+i) - i't)\ 



= (^^Y)2 i^^W^t ~ ^*ll2 + 2i (0t - ^t,f{xt+i,yt+i) - ^t) + \\f{xt+uvt+i) - Ml) ■ 

If (pt G S, then (j)f ~ipt — and the middle term vanishes. Otherwise, since Tf > and S is an A-set, 
there must exist a halfspace- forcing example ipt,Ht) with p(^/'t, iJj'^) < tj, and Lemma 4.3 grants 
{(t>t - 4>t,f{xt+i,Vt+i) - < Tt'j. Applying the inductive hypothesis. 



(4.6) < 



t7^ + 27t^^rt 



< 



7^ + 27ELiTt 
t + 1 



□ 



Remark 4.7. This statement also grants the approachability of any set S" which contains an A-set S: 
simply run g* on S' . But it is unclear how to produce an approach strategy for S" directly. Suppose 
S' is the union of an A-set, and another set which is nearly an A-set: a small piece is missing in 
such a way to render it unapproachable. The approach strategy must somehow rule out gravitating 
towards the second, damaged set; detecting this difficulty does not appear tractable. Please see the 
examples of Appendix \K\ for further discussion. 

4.2. Sufficient Conditions for Non-approachability. The first step is complementary to Lemma [473| 
quantifying how much a single halfspace-forcing counterexample benefits the 3^-player. 

Lemma 4.8. Let (0, H) be a halfspace-forcing counterexample. Set t :— p^ijj, H'^) > 0, e := 

e(T) :— 8"^"^2+T^) '^^ '^''^^ ^ — [8/^1 given. Then for any p G B('ip,2e), and any sequence 
{xi)i>i, there exist {yi)i>i and M < \T"fe/8~\ where 

p (^0, (T + M)-\Tp + 2/.))) < Pi4>, S) - e. 

Under the stronger condition that H'^ may be 1-forced by y, there exists a single y so that the choice 
Vi — y grants the above property for any sequence (2^i)i>i. 



This derivation is mechanical, and thus pushed to Appendix |B.1[ but the idea, which appears in 
Figure[2] is simple. By assumption, there exists a point ip € S satisfying tp S B{(f>,p{<j), S)) n S, and 
a halfspace H whose boundary is r away from ip, and H is not 1-forcible by X. Correspondingly, 
is 2-forcible by y. 

To see how this helps y, by properties of P balls and boundedness of/, every line connecting 
tp to f^f{X,y) must pass interior to B{(j), p{(j), S j). This remains true for a tiny neighborhood 
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around V"- Thus it suffices for the y player to force points in H'^: regardless of how the X player 
chooses, a future center of gravity will eventually land interior to B{<j)^ p{<j)^ S)). The extra work in 
the lemma is in producing e as a function of t, allowing uniform controls for various halfspace-forcing 
counterexamples . 



Definition 4.9. Define e(T) as in the statement of Lemma 4.8 For any set S C W^, define the 
excess of S with tolerance r > as 

£r(S') |-B(V', e('''))° : ■;/;, ^. iJ) is a halfspace-forcing counterexample with p{^,H'') > t|. 

Define Vr{S) '.^ S\[JueEAS) U- 

As per the following lemma, the operator Vr removes points which can not be used by an approach 
strategy. A similar tool and subsequent limiting argument appeared in the analysis of Hou J3J and 
Spinat |10j . albeit without r, which will be used in constructing the opponent strategy. 

Lemma 4.10. For any r > and S C M'^, S is approachable ijfVr{S) is approachable. 

Proof. (=>) Suppose S is approachable, but contradictorily that S' :— Vt{S) is not approachable. 
Necessarily, Vt{S) ^ S and Er{S) is nonempty. Let g be any approach strategy for S; it must fail 
to approach S' , and therefore there must exist an opponent strategy () such that (j)t (z S \ S' for 
infinitely many t. Now choose Tq > [8/e(r)], and let Ti be the value provided by g guaranteeing 
(j>t S ^e{T) for all opponent strategies and t > Ti. Finally, set T :— max{ro,Ti}. Consider the 
modified strategy (]' which executes as f) until some t > T satisfies </)( G 5 \ S' . Thereafter, it follows 



the choices granted by Lemma 4.8 (with p = (pt), and thus guarantees the existence of t' > T with 
4>t' ^ Se{T)i contradicting the approachability of S by g. But g was arbitrary, and thus S is not 
approachable. 

Supersets of approachable sets are always approachable. □ 

Tiieorem 4.11. Let compact S C M'* be given, set So S and S'i+i :— "^i/(i+i){Si) . Then the 
limit Sao ( in Hausdorff metric ) exists. Furthermore, exactly one of the following statements holds: 

(1) There exists N € N with Sn = for all n > N , and each Si is not approachable; 

(2) 5*00 is a compact nonempty A-set. 

The tolerance l/{i + l) will make it easy to control the behavior of the eventual opponent strategy 

Proof. Suppose there exists some N such that Sn = 0; since V only makes sets smaller, it follows 
that Sn — ^ when n > N, providing Soo ~ 0- Next, the empty set is never approachable, thus 



Sn is not approachable when n > N. But Lemma 4.10 grants that Si is approachable iff Si+i is 
approachable, and so by N applications of this lemma, it follows that every Si is not approachable. 

Now suppose there does not exist any N with S^ = 0- Thus each Si is compact and nonempty, 
and 5*00 exists and is a compact nonempty set by the completeness of the Hausdorff metric on 
compact nonempty sets. 

Assume contradictorily that Sac is not an A-set, meaning it has a halfspace-forcing counterexample 



{(j),'ip,H), and set r :— p^i/j^H'^) > 0. By Proposition B.6 there exists 5 > so that any set S' 
satisfying A(S", Soo) < S has a halfspace-forcing counterexample {(/>', tp' , H') with p{4'' , {H'Y) > t/A. 

Choose j so that /\[Soo,Sj) < min{(5, e(T/4)/2}. Thus £i/(j+i)(5'j) contains e(T/4))°. But 

V only shrinks sets, meaning A(S'oo, Sj) > A{Sj+i, Sj) > e(r/4), a contradiction. □ 

Consider the case that 5* is not approachable; the above theorem grants the sequence {Si)fLQ with 
So — S and Sn — 0- Now define Ei := Si \ Si+i for z S (0, . . . , iV — 1), and note that each Ei is 
disjoint, and S — u'ii^^Ei. In this way, the operator V peels S into a finite sequence of concentric 
sets, like the rinds of an onion; the strategy t)*, depicted in Figure [3j is to use Lemma 4.8 to move 



through these rinds, eventually exiting S entirely. It is interesting to contrast the complexity of (]* 
with the triviality of g* 
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Figure 3. 3^-player strategy f)*, escaping S rind by rind. The small circles denote 
the regions surrounding specific halfspace-forcing counterexamples, within which an 
iterate may fall and still make use of the counterexample (cf. Lemma 4.8). These 



balls are depicted as exceeding the onion rinds since Lemma |4.8[ which determines 
6{S), only provides a lower bound on their size. The arrow, abstractly indicating 
the path out of S, may consist of a tremendous number of iterations. 



Definition 4.12. Fix any compact set S, and let {Si)i>o be as in Theorem 4.11 When there 
exists N such that Sn = 0, define S{S) :== e(l/iV) and r(S') := \S/S{S)']; otherwise, S{S) := and 
T(S) := oo. Finally, for any </>, 

{-1 when (5(5') > and ^ 

max{i : (j) G {Si)s(^s)} when S{S) > and <j) e Ss{s), 
oo otherwise. 

Definition 4.13. The 3^-playcr strategy f)* = (f)t)i>i is 

arbitrary when t < T{S); 



when t = T{S), or t > r(^) and ^ Js('^t-i), 

there exists a halfspace-forcing counterexample (i 
with < 2e(l/(Js(0t) + 1)) and p{i:,H^ 



I > l/{3s{(l>t-i) 



1), 



choose any y given by Lemma 4.8 (with p = (pt), 
satisfying 1-forcing by y if possible; 

when <> T(5) and Js('/'t) = 3s('/'t-i), 
choose {cl),tp,H) and p as for 0t_i, 

choose y' according to Lemma |4.8[ again trying to 1-force. 

A similar mechanism was used by Hou [5J proof of Theorem 3] when proving necessary and 
sufficient conditions for approachability (that is, the nonconvex form of Blackwell's Approachability 
Theorem, presented here as Theorem 4.15). There, halfspaces were not used as a primitive tool 



for the opponent: rather, the strategy was built up by considering a more abtract set guaranteeing 
progress to the opponent (cf. Hou's insufficient subsets Definition 1]). Using halfspaces grants an 
arguably constructive opponent strategy, but more importantly provides the backbone for measuring 
the effect of minimax structure. 

Proposition 4.14. Let S CW^ be given, and suppose T(S) < oo. Then for any approach strategy 
and any T, there exists t >T so that, when {yi)i>i is chosen by I)* , 

Moreover, if every halfspace-forcing counterexample {(f),ip,H) encountered by f)* is 1-forcible by y , 
then f)* is an avoidance strategy. 
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Proof. From T{S) < oo it follows that d{S) > 0, and for any cj) £ S'5(5), ^5(0) < 00. Suppose 
contradictorily that there exists T > T{S) so that (pt € Ss(s) for t > T. In particular, this means 
mint>T3s(0t) =: j > -1- 

Let t > T{S) be the earliest iteration with Jsi'Pt) = j, which by definition of 3s and the fact 
Si 3 Si+i grants 4't G {Sj)s(s) \ {Sj+i)5{S)- This 4>t satisfies the middle condition in the definition of 
f)*; it must be verified that the conditions for Lemma [ITsl namely the existence of a halfspace-forcing 
counterexample and nearby point p, are actually satisfied. 

There are two cases for the location of c/)*: either it is in fii/Q+i) (iSj), or it is in (£i/(j_|_i)(5'j))(:(5). 
Recall that £i/(j+i)(S'j) is the union of balls of radius at least e(l/(j + 1)) > e{l/N) = S{S), where 
the center -0 of each can be made into a halfspace-forcing counterexample {(p^il^^H). It thus suffices 
to take p = 4>t'- when (j^t G £i/(j+i)(S'j), just take some ball in fii/Q+ij containing (j)t, otherwise 
choose the closest ball, and the triangle inequality gives what is needed (since the conditions on 



Lemma [48] allow distances up to 2e(l/(j + 1)), and (5(5) < e(l/(j + 1))). 

As such, 'isii't+i) ^ 'is{4>t)- It is a contradiction if the inequality is strict, so treat it as an 
equality. But this will cause a chain of iterations all landing in the final case of the definition of [}*. 
Since the same halfspace-forcing counterexample is used, this chain fits exactly with the conditions 



of Lemma 4.8 and thus some eventual iteration t' > t will satisfy ^siff't') < Js(0t), a contradiction. 
Since t was the least counterexample, there are no counterexamples, and the result follows. 

Finally, suppose the extra condition that every halfspace-forcing counterexample (0, ip, H) has 



H'^ I-forcible by 3^. Then the stronger guarantee of Lemma 4.8 is at play, and (pt ^ Ss(^s) can be 
guaranteed regardless of the choice of {xt)t>i- □ 

4.3. Approachability and Minimax Theory. Combining the results so far grants a proof of 
Blackwell's Approachability Theorem in the general (nonconvex) form of Hon [6] and Spinat |10| . 
but in the general setting of this manuscript, with no reliance on minimax structure. 

Theorem 4.15. Let S CW^ be given. Then S is approachable iff S contains a compact A-set. 

Proof. Without loss of generality, S may be presumed compact. If S contains an A-set, then 
Theorem |4. 5| provides approachability. If S does not contain an A-set, then 5*00 C S* is not an A-set, 



and Theorem 4.11 provides non- approachability. □ 



The next question then, is what is gained by minimax structure? The answer goes back to 



Proposition 3.1 minimax structure allows implies that 2-forcible halfspaces are also 1-forcible. This 



effect propagates to approach games: minimax structure makes the player order inconsequential. 

Theorem 4.16. Suppose {X,y,f) has minimax structure, and let S C R'^ be given. Exactly one of 
the following statements holds: 

(1) S is approachable with strategy g* ; 

(2) S is avoidable with strategy f)*. 



Proof. Suppose S contains an A-set: by Theorem 4.5 it is approachable with strategy g 



Now suppose S does not contain an A-set; by Theorem 4.11 Q S not an A-set means T(S) < 
00 and Proposition |4.14| can be applied. But minimax structure, combined with Proposition |3.1[ 
grants that every halfspace-forcing counterexample {(f>,ip,H) has H'^ 1-forcible by y. Thus the 
stronger guarantee of Proposition |4. 14| holds, and [}* is an avoidance strategy. □ 

Note that without minimax structure, there exists sets which are neither avoidable nor approach- 
able. It suffices to consider a game in with a :— infj. supj^/(a;, y) > supy inf xf{x,y) —: b, just as 
in Section|3] In particular, the set H := (—00, (a -I- 6)/2] is neither approachable nor avoidable. 
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5. Stochastic Games. 

The final missing piece is stochasticity; throughout this section, take X and y to be families of 
distributions. For convenience, given a pair of distributions (/i, i^) € X x y, let E/ denote the map 

This setting is nearly an analog of the deterministic game: each player has access to the history of all 
distributions chosen so far, but additionally the sampled payoff /(Xt, Yt) where {Xt,Yt) ~ {nt^vt). 
Accordingly, strategies are now families of maps from these augmented histories to members of X 
and y. There is some disagreement between authors as to the exact contents of the history; the 
history here was also used by Hou 

Definition 5.1. A set S (or, for clarity, a tuple {X^y,f,S)) is stochastic approachable if 

3b . Ve > . 3T . Vf) . P{3t > T . (I)t ^ S,) < e, 
where the probability P is taken over the player history product distribution. 

The crucial result is that the family of approachable sets is effectively the same, with and without 
randomness. Moreover, the method of proof reveals that the deterministic strategies q* and ()* can 
be simply adapted to handle the stochastic case. 

Tiieorem 5.2. Let X andy be families of distributions over a pair of sets \ andY, andf : XxY — ^ 
M'^ and Ef : X x y ^ M"^ are as above. For any set S C M'', {X,y,f,S) is stochastic approachable 
iff {X, y, E/, S) is approachable. 

When adapting g* and (]* to the stochastic case, the following concentration result will be used. 
Although the independence statement may seem too strenuous, it will suffice because the adapted 
strategies will never care about the sampled values Xt ~ fit and Yt ~ Vf, but rather only use the 
source distributions fit and vt. 

Lemma 5.3. Let any e > and any sequence {Zi)fL^ of d- dimensional independent random vari- 
ables be given with \\Zi\\ < 7 almost surely. Define Sn "it-^^ '^^=1 ^i- Then for any N > 
7i i„ / M A 

P(3n>iV.||S„-E(5„)|| >e)<e. 

Proof. First consider any fixed n > N. By norm equivalence, ||5„ — E(S'„)|| < \\Sn — E(5„)||i. 
Applying Hoeffding's inequality to any fixed coordinate j (which can vary by at most 27), 

P{\{Sn)j - {E{Sn))j\ >e)< 2exp(-2n6V(27)'). 
Unioning these events for all coordinates and all 71 > A^, it follows that 

P{3n>N.\\S,,-E{S,,)\\>e)< ^ P (||5„ - E(5„)||i > e) 

n>N 

< 2dexp{-2Ne'^/-f^) ^ exp(-ieV(27^)) 

i>0 



< 6(1 - exp(-2eV7')) E (exp(-eV(27')))' 



i>0 



□ 



Theorem \5.SX (-4=) Suppose {X ,y , Ef, S) is approachable, and let e > be given. Define a stochas- 
tic approach strategy g as follows. In every iteration, g invokes g* (with schedule Tt = 72"*). Since 



S is approachable, by Theorem 4.15 it is an A-set; thus, for t>Ti:= [127Ve^l E{(j)t) G S,/2. Next, 
even though there may be dependence between Xt and Yt across iterations, they are independent 
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given their distributions and vt- As such, Lemma [573| may be appHed, and there exists T2 so that 
P{3t >T2.Ut- HM\ > e/2) < e/2. Taking T max{ri,T2}, 

P{3t>T.<j>t^S,)<P{3t>T.<j>t^ B{E{cj)t),e/2)) + P{3t>T. E(<^0 ^ S,/^) < e. 

(=>) This direction is estabhshed via contrapositive: suppose {X,y, E.f,S) is not approachable, 
and construct an opponent strategy f) by once again feeding the distribution history to a determin- 



istic strategy, this time f)*. By Proposition 4.14 there exist T{S) and (5' > so that E((/)t) ^ Ss' for 



infinitely many t; set d := mm{S' , 1}. Invoking Lemma 5.3 (with the same independence considera- 
tions as for the converse), there exists T' such that P(Vi >T'.4>te B{E{(j)t),S/2)) > 1 - S/2, and 
thus, for any T > max{T', T(S')}, 

P{3t>T.<Pt^Ss/2) >l-S/2. 

□ 

Remark 5.4. Note E/ is bilinear, and suppose X and 3^ are compact convex. This grants minimax 
structure (cf. Appendix |d]), and one may view the stochasticity as an operator embedding a tricky 
game into a more structured setting. 

Appendix A. An Example. 

Many beautiful approachability examples can be found elsewhere. Here are two favorites: 

• Blackwell [1] presents a game which is neither approachable nor excludable; 

• Spinat jlQj presents an approachable nonconvex set containing no smaller approachable set. 
This section presents a very simple game to demonstrate the relationship of 1-forcing, 2-forcing, and 
approachability. For its duration, fix 

X ■.= y -.= {[1^^] :ae [0,1]}, 



X2y2 

Since this game is symmetric, it suffices to consider the perspective of one player. Notice that the 
minimal 1-forcible sets are precisely 

f{x, 3;) = { [ ] + [ ] : a e [0, 1] } ; 

these are minimal in the sense that every 1-forcible set must contain for some a;, and each 
has no 1-forcible proper subsets. 

For a convex approachable set that is not 1-forcible, consider 

S-Q :={(a,a) :ae [0,1/2]}. 



Since every halfspace containing Sq also contains some Lx-, Theorem |4 . 1 5 1 grants approachability. 

This game is a tensor of order 3, and the results of Appendix [P] grant it has the minimax property. 
But there exist 2-forcible sets which are not halfspaces, thus not covered by Proposition |3.1[ and are 
not approachable. Consider in particular the set 

5i := ([1/2, l]x{0})u({0}x (1/2,1]). 

Since S'l intersects every set L^, it follows that it is 2-forcible; by the aforementioned symmetry of 
/, it is 2-forcible for X and for y. On the other hand since Sq is approachable but p(S'o,S'i) > 0, 
the 3^-player can play g* to approach 5*0, meaning Si is not approachable. 

Finally, as per Remark |4.7[ there exist tricky supersets of A-sets for which it is not clear how to 
construct an approach strategy (without resorting to determining an inner A-set, and invoking g* on 
it). In particular, choose any xi,X2 S X with xi ^ X2, and construct S2 by removing a small piece 
from in L^-i^ U Lx2- Any approach strategy for S2 must know to avoid Lx2', otherwise, the y- 
player could let arbitrarily many (j)t stay inside the disconnected piece of , and then begin forcing 
points inside L^d thus taking (pt outside of 52- Since approachability requires a uniform bound over 
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all opponent strategies, this means the provided strategy for X is not an approach strategy. Thus, 
it is necessary for the ^Y-player strategy to knowingly avoid this disconnected piece of ■ 

Appendix B. Geometric Facts. 
This section collects a few geometric facts requiring careful proof. 



B.l. Proof of Lemma 4.8, Throughout this section, suppose is merely a halfspace- 



forcing candidate; 1-forcing of _ff by A" or 3^ will only come into play at the end. As in Lemma 4 
set T := H") > 0, and set H' := IF . 



Lemma B.l. Set t(1-7/V7^T^), onrf ei := teo/ {2./^f^T^) . For any z e H' {X ,y) , 

there exists 77 G (0, 1) such that Birjip + (1 — ri)z^ ei) C _B((/), pijj), ^)) and p{r]ip + (1 — 77)2, H') > ei . 

Proof. First, it suffices to consider z on the boundary of H': given z' G {H')° with z denoting the 
intersection of [-0, z'] with the boundary of H , the desired 77 for z can be converted into rf G (0, 1) 
for z' satisfying r/'-i/; + (1 — ?7')2' = rj^j + (1 — 77)2. 

Second, discard the scenario that {ip,z,(f)} are collinear: since ei < t/2 < p{(j>,ip)/2, taking 77 
close to 1/2 suffices. 

Third, it suffices to exhibit an 7y e [0, 1) satisfying the single property B{rj^ + (1 — 77)2, eq) Q 
B{(j), p{(j),'(l:)). This 7/ may potentially violate the second condition above: perhaps p{ri'4' + (1 — 
r])z,H') < t\. To see how this can be adjusted, set z' := 777/; + (1 — 77)2 and (\)' to be the projection of 
z' onto [0, 7/;]; thus the right triangle {t/;, (/)', z'} has short sides with lengths /o(7/', </>')> r — ei > r/2 
and p(0',z') < 7. By similarity of triangles, the point z" along [^',7/;] which is eo/2 away from z' 
must satisfy 



p(z",iJ=)>p(z",[z',0'])=p(z",z') 



- 2 ( + 472 ) 



2 



Meanwhile, B{z",ei) C B{z" , eo/2) C B{z',eQ), meaning both properties are satisfied. And since 
z" € (7/), z), this grants an 77 S (0, 1) with all desired properties. 

The remainder of the proof will be divided into the two cases, as in Figure[4j whether z, ip) < 
tt/2 or not. Set 0* to be the intersection of [0,7/)] with the boundary of H, meaning p{'ijj,(j)*) — t. 

Suppose /-{(f>, z^tjj) < 7r/2, and designate z* as the point along [z,^p] satisfying [2;*,7A] -L [z*,0], as 



in Figure 4a This z* will provide the eventual 77. By similarity of triangles {7/1, z* , cp} and {ip, 4>* , z}, 

p{z*,cP) ^ p{z,<P*) 
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Rearranging and making use of p{(j)* ^ z) < 7 and p{ip, (f)) > p{ip, </>*) = t, the desired inequality is 

p(</.,v)-p(^*,</') = p(</'» (1- . I,., , >p(0,^) (1- . / , , = ) 

Finally, consider Z(0, z,-;/)) > 7r/2. This time, place z* along the line through {z, 0*} so that 
[z*, (^] _L [z*, f/'] as in Figure 4b By construction, p(z*, > p(z, (/)), thus it suffices to upper bound 
p(z*,0), and z will be the desired point, meaning 77 = 0. By similar of triangles {'0,</', 2^*} and 

pi<l>,z*) </>*)■ 
Using p{iP, (f) > 0*) = T and < 7, 



with the remainder as before. □ 

Lemma B.2. Set 6-2 :— ei/2. For any p S B{tp, t-i), and any z E H' Of {X, y), there exists rj € (0, 1) 
such that B{rip + (1 — r/)z, £2) C _B((/), p{(f), ip)) and p{rip + (1 — r/)z, H') > 62- 

Proof. Choosing the rj granted by Lemma |B.1[ 

p{t]p+ (1 - ri)z,(}>) = \\r]{p - tjj + ip) + {I - ri)z - (f)\\ < ri \\p- V^|| + ||?7^ Z ~ '^^^ ~ Pi^'A) - £2- 
For the other property, 

p{rip + (1 - 7?)z,i/') = inf \\rjp + (1 - r7)z - q\\ + - ||?7(^ > P('7V' + (1 " '7)z, H') - es- 

□ 

Lemma B.3. S'et €3 := £2/2 = e. Lei anype B{'4>,e2), T > [87/63!, and {z,)fL^ e {H'nf{X,y))^ 
with N = [T7e3 /8] be given. Then there exists an integer M < N such that 



Proof. For every z £ H' n f[X,y), let 77^ e (0, 1) be the value granted by Lemma B.2 so that 

B{ri,p + (1 - ry,)z, €2) C V^)) n H. 

Next, set [4 := B{rjzP + (1 — ??z)2, £3), and U to be the convex hull of the union of all Uz\ it follows 
that U C B{(j), p{(t), 1/;) - 62) and H") = inf„gw 7/^=) > 62- 
For every i < N, consider the partial averages 

T + « 

and take Wi to denote the point on the boundary of H' so that qi G [p, Wi] (or — qi if q^ G H'). 
Correspondingly, choose rji as provided by Lemma B.2 so that r]ip+{l — rii)wi G U, and set fii G [0, 1] 
so that Qi — pip + (1 — pi)wi. Since TV > Tje^/S and 7 > 0, 
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Figure 5. Objects in the proof of Lemma B.5 



meaning in particular that p{qN, H') < 63/8, so has gotten beyond U, thus /xjv > rj^. The final step 
will be to show {qi)fLi must have actually passed through U. 

Now let k be the first index such that fj,k. > rjk, meaning < rjk-i- Suppose contradictorily 

that qk and qu-i ^ U. Since T > 87/63, it follows that \\qk — qk-i\\ < £3/8. This implies that 
the ball centered at r]ip + (1 — rii)wk with radius 63/4 (which is within B{riip + (1 — 'r]i)wk, £3) Q U) 
contains a point along the line [p, qu-i], and as such qk-i £U, a contradiction. Thus the desired M 
exists. □ 



Lemma \4^ It is given that ((f),ip,H) is a halfspace-forcing example, by which it follows that H'^ 
and hence H' can be 2-forced by y. Given a sequence (xi)i^i, this grants {yi)iLi with /(x;, £ 
H' C\f{X,y), whereby Lemma B.3 may be applied, and the result follows. 

Now suppose the stronger condition that H"^ (and H') can be 1-forced by y. Thus there exists 
a single y so that the choice yi = y grants f {xi,yi) E H' C^ f{X ^y), whatever the choice of Xi G X. 
Once again, Lemma B.3 may be applied. □ 



B.2. Halfspace-forcing Counterexamples of Similar Sets. This subsection will use the exis- 
tence of a halfspace-forcing counterexample ((/>, ijj, H) on a set S to produce another counterexample 
on some similar set S' . It will be supposed that p{(j}^'ip) = p{'ijj,H'^) =: r; this comes without loss 
of generality, since otherwise p{(f>,'ip) > r, in which case some other 0' may be chosen along the 
segment [(j),ip], but closer to ip, and still forming a halfspace-forcing counterexample {(f)' , ijj , H) . 

To this end, given any pair (0, q), define H{(j), q) to be the halfspace with normal q — 4> having 
on its boundary; that is, 

(B.4) H{^, q) := {z eM." : (z, q - cf>) < {<i>,q ~ 0)}- 

For instance, after the adjustment placing (f> on the boundary oi H, H — H{(j>, ipY, and (0, -0, H{(j), V')^) 
is a halfspace-forcing counterexample. 

For any pair (0, q) and S £ (0, p{4>^ q)), let Rs{4>i q) be a shell of radius p{<j), q) and width 5 around 

0: 

Rs{c^, q) S(</), p((/., q)) \ Bi<j>, p[c^, q) ~ Sf = {z eW : p{<i>, q) > p[c^, z) > p{<j>, q) - S} . 

Lemma B.5. Let 0, ■0 be given where H{4>,il)) can be 2-forced by y, and set r :— p{(f>,ijj) and 
(j)' := {(j) + 0)72. Then there exists 5 > Q so that every q G B((j)',T/2) D Rg satisfies 

(1) p(q,0.)<r/4, 

(2) iJ(0', q) can be 2-forced by y. 

Many of the relevant quantities appear in Figure [5) 
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Proof. For any S € (0, t/2), consider two maximization problems, where capitalization refers to the 
presence of multiple optima: 

qs e Argmax{Z(V', (j),q):qe B{(t)' , t/2) n i?^}, 

q's £ Argmax{p(V',g) : q G B(0',t/2) f] Rg}. 

By rotational symmetry of all quantities around [0, ip] , it suffices to consider qs , q'g which lie in the 
same plane, and lie on or above [0,^]. In this case, qs — q's- this follows since the farthest point 
from ip must lie on the inner edge of Rs, and it must be as high above [(/>,')/'] as possible. 

As such, to establish the first desired property, note that p^ip, qs) decreases continuously as (5 J, 0, 
and thus there exists Si so that p{tpi iSi) < t/A. Since qs is the farthest point, the property follows. 

For the second property, since H'^ can be 2-forced by y, it follows that H'^ nf{X,y) can be 
2-forced by 3^. Now consider any point q G r/2) (iRs, and consider the halfspace H{(f>',q) as 
defined above. Once again, it suffices by rotational symmetry of the relevant quantities around [(j), ip] 
to consider q as lying in a plane above [-0, (p'] and H((j)' , q) appearing as a line within this plane. If 
H{(j>',q) does not cross H'^ r\f{X,y) within this plane, then H{(t)',q) can be 2-forced by y. 

To this end, since Z{iJ; , (p' , qs) — niax{Z(-0, 0, g) : q e t/2) n Rs}, it suffice to prove that 

H{(j>',qs) can be 2-forced. But as S I 0, the preceding analysis grants qs becomes arbitrarily close 
to ip, thus the normal of qs — 4>' of H{(j)',q) becomes increasingly close to that of H{(j),ijj), whereas 
they intersect [0, V'] a-t points t/2 apart; so there must exist a 62 sufficiently small. 

Setting 6 := minjJi, S2}, the result follows. □ 

Proposition B.6. Let S C R'^ be given with halfspace-forcing counterexample {(j), "0? H), and set t := 
p{(f>, ip). Then there exists 6 > so that every S' C M.'^ satisfying A(S', S') < S has a halfspace-f orcin g 
counterexample (jp'^^q' , H{(j)'g^q')'^) with p(H((j)'^,q'),q') > t/4, where H{-, ■) is as in Equation (B.4). 



Proof. Let (5o > be as provided by Lemma B.5 set (5 := (5o/2, and let S' be any set satisfying 
A(S',S") < (5o/2. Also following Lemma [RS] set 4>' := {ijj + </«)/2. Define 

, , So f 
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^^"^^ 2VII0-^I 

these are just copies of (j>,(f)',ip shifted by Sq/2 along the direction to tp from cj). As such, there is a 
bijection (via this shift) granting 

Bi^', t/2) n Rsoi<P, V) 3 g ^ 9. G B{<P'^,t/2) n RsMs,^s)- 



It follows from Lemma B.5 that every such qs satisfies qs G B{ijjs, t/4), and H{(f)'s, qs), which contains 
H{(j>',q), is 2-forcible by y. 

Since B{(f), t)° n = 0, the triangle inequality grants 

B(0„T-<5o/2)°n5 = 0, 

B{(f>s,T-So)°nS' = 9. 

Combining this with the definition of Rsg{(l)s,ijJs), 

snB{(t>s,T) c Rs„i(f>s,iJs), 
s'nB{(f>s,T) c i?5,(0„v.). 

So by the choice of So and guarantees of Lemma |B.5| (points qs in this cap satisfy qs G B{tps,T/4:)), 
SnB{^'s,T/2) C B{ijs,T/4)nB{(t>'s,T/2)nRs„{<Ps,i^s) C B{iPs,r/4)nRsMs,A), 

s'nBi^'^,T/2) c B{^Ps,T/^)nB{^'^,T/2)nRsMs.^s) c i3(0„T/4) n i?5o(<^«,^.). 
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In particular, if S' n B{(f)'g,T/2) is nonempty, then the closest point q' £ S' to (p'^ will fall within 
B{iPs,t/4:) n Rso{(j)s,'4's), and satisfies all desired properties: H{(f>s,(l') was shown earlier to be 2- 
forced by y , thus {(p'g, q' , H{(f>'g, q')) is a halfspace-forcing counterexample for 5"; combining ^s) < 
t/4 with = r/2 grants p{H{^'^,q'),q') > r/4. 

To this end, note that by construction that 

Biij,6o/2)CRs,{cbs,i>s)- 
S' satisfies A{S,S') < 6q/2, meaning there exists q' inside S' n Rsgicf'sji's)- The result follows. □ 

Appendix C. A Limit Property. 

The proof of Spinat's |10| Lemma 1 appears to be incomplete. The statement is interesting, so 
this appendix establishes a strengthened form, albeit by different means. 

Lemma C.l. Let a sequence of compact approachable sets {Ui)i>i he given. If{Ui)i>i is convergent 
in Hausdorff metric, then its limit U is a compact approachable set. 



Proof. Since each Ui is approachable, Theorem 4.15 guarantees that it contains a compact (nonempty) 



A-set Ai. Completeness of the Hausdorff metric on compact nonempty sets grants (perhaps by pass- 
ing to a subsequence) the {Ai)i>i have a limiting (compact nonempty) set A. 

It must be the case that A C U, since otherwise by compactness there exists z £ A\U with 
some p(z, U) =: 5 > 0. Now consider j (with respect to the above subsequence) large enough for 
A{Uj, U) < S/i and A{Aj,A) < S/2; it must be the case that Aj % Uj, a contradiction. 

Finally, note that A is an A-set. Suppose contradictorily that {4),ijj,H) is a counterexample to 



halfspace-forcibility with r := p{ip,H'^). By Proposition B.6 there must exist a tiny 5 > so that 
every A' with A{A, A') < S has halfspace-forcing counterexamples, whereas there exists an A-set Aj 
with A{A,Aj) < S. 

Since U contains an A-set, Theorem |4.15| grants that it is approachable. □ 
Appendix D. Function Families Satisfying the Minimax Property. 

Recall's Sion's [9 minimax theorem, as stated by Komiya ;7 , with a minor tightening to compact 
y for applicability here. 

Theorem D.l (Sion [S]). Let £ : X x y ^ R be given where X and y are compact convex subsets 
of linear topological spaces, £{-,y) is quasiconvex and lower semi- continuous for every y € y, and 
g{x, ■) is quasiconcave and upper semi- continuous for every x X . Then 

min max 17(2;, y) = maxmin (7(2;, w); 

in particular, each optimization is attainable. 

Notice that Sion's Theorem may be applied to the case that X and y are families of distributions. 

Proposition D.2. Let f : X x y K'' be given. {f{-,y),X) is quasiconvex and lower semi- 
continuous for every [y, A) G 3^ x and {f{x, •), A) is quasiconcave and upper semi-continuous for 
every (x. A) G A" x M'' iff (/(•, •), A) is continuous and monotonic in each parameter. 

Proof. (=>) Fix y and A; since both (/(•,?/), A) and (/(•,y),— A) are quasiconvex and lower semi- 
continuous, it follows that each is continuous, and unrolling quasiconvexity grants, for any a G [0, 1], 

min{(/(xi,2/). A) , {f{x2,y),X)} < {f{axi + {I - a)x2,y),X) < max{(/(a::i, y). A) , {f{x2,y),X)}, 

which is the statement of monotonicity. An analogous argument holds for every x and A. 

(■<=) Continuity implies upper and lower semi-continuity, and every monotonic function g satis- 
fies, for every xi, X2 and a G [0, 1], mm{g{xi), g{x2)} < gictxi -\- (1 — a)x2) < max{g{xi), g{x2)}. □ 

In the stricter scenario of convexity/concavity, the resulting function family is vastly more con- 
strained. 
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Proposition D.3. Let f : X x y ^ M.'^ be given. (/(•,?/), A) is convex for every (y, A) G y x 
and {f(x. •), A) is concave for every (x, X) E X x M'' iff /(•, •) is affine in each param,eter. 

Proof. (=>) Since for any A and y, both (/(•,y),A) and (/(•,?/),— A) are convex, it follows that 
(/(•, y), A) is afRne. Thus let any a e M and xi,X2 X he given; for any y Gy, 

d 

f{axi + (1 - a)x2,y) = ^ {f{axi + (1 - a)x2, y),ei) Si 

i=l 

d 

= (/(a^i, y), ei) + (1 - a) (/(X2, y), e^)) 

1=1 

= af{xi,y) + (1 - a)f{x2, y). 

Repeating this proof from the perspective of f{x, •), the result follows. 
(-^=) Let a € [0, 1] and xi^X2 € A" be given. Then, for any A G 

{J{axi + (1 - a)x2,y),\) = {af{xi,y) + (1 - a)f{x2,y),X) = a{f{xi,y),X) + (1 - a) {f{x2,y),X) ■ 
Again, the proof for y is analogous. □ 
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